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ABSTRACT 


The  paper  presents  an  algorithm  for  solving  the  zero-one 
Integer  programming  problem.  In  contrast  to  the  usual  approach, 
which  reduces  the  problem  to  finding  the  optimal  values  for  variables 
restricted  to  values  of  zero  and  one,  we  view  the  problem  as  finding 
an  optimal  map  among  a  class  of  mappings  of  one  finite  set  into 
another.  The  basic  approach  is  to  characterize  the  statistical 
structure  of  the  finite  class  of  maps.  Our  technique  consists 
of  trying  to  identify  the  optimal  feasible  map  in  a  class  of 
maps,  by  introducing  random  variables  as  functionals  on  the  class 
of  maps.  V/e  derive  explicitly  the  statistical  properties  of  the 
class  of  maps  associated  with  the  zero-one  integer  programming 
problem.  Using  the  mean  and  variance-covariance  matrix  the  idea 
of  confidence  level  enumeration  is  developed. 


A  NEW  APPROACH  TO  DISCRETE  MATHEMATICAL  PROGRAMMING 

by 

G.  Graves  and  A.  Whins ton 

Introduction 

We  shall  present  in  this  paper  an  algorithm  for  solving 
the  following  problem: 

Min.  Ic  x 

J  J 

(1)  s.t.  <  bi  i**l,2,...,m 

yi  *  (0,1) 

The  above  linear  Integer  programming  problem  is  a  specialization  of 
the  following: 

(2)  ^gij*  V  -  bi  i=l,2,...,m 

XJGIJ  =  . sj) 

Note  that  no  conditions  such  as  convexity  or  differentiability  are 
imposed  on  the  function.  The  algorithm  to  be  outlined  below  can 
be  used  to  solve  problem  (2).  However,  for  purposes  of  exposition 
it  is  convenient  to  deal  with  problem  (1)? 


2. 


This  paper  presents  the  theoretical  foundations  for  a 
new  approach  to  integer  programming.  On  the  basis  of  the 
theoretical  arguments,  various  specific  computational  procedures 
are  developed  which  could  be  used  to  solve  the  integer  programming 
problem.  However,  definitive  computational  results  are  not 
presented.  In  future  papers  we  plan  to  explore  the  various 
computational  options  developed  here. 

The  literature  devoted  to  presenting  methods  ior  solving 
problem  (1)  i~  very  extensive.  A  comprehensive  survey  has  been 
presented  by  Ballnskl  (2  ].  Roughly  speaking  the  approaches  to 
this  problem  can  be  divided  into  three  groups.  The  first  point 
of  view  Initiated  by  Gomory  involves  generating  the  convex  hull 
of  the  Integer  problem  and  then  employing  linear  programming 
techniques.  An  elegant  theory  has  been  developed  by  Gomory 
to  demonstrate,  among  other  things,  finite  convergence.  However, 
the  computational  experience  with  the  method  has  proved  incon- 

2 

elusive.  This  seems  to  be  especially  true  for  larger  problems. 

The  second  approach  can  be  characteriaed,  in  general, 
as  an  enumerative-combinat or ial  approach  to  tne  problem.  Many 
researchers  have  made  contributions  to  developing  this  theory. 

An  early  paper  of  Gilmore  [  5  J  presented  an  algorithm  for  the 
quadratic  assignment  problem  within  this  framework.  Recently 
fork  by  Balas  [  1  J  and  Glover  (  6  J  has  developed  an  elegant 
enumeratlve  algorithm  to  solve  a  linear  integer  problem. 

Basically  the  method  involves  an  intelligent  search  through 


3. 


all  possibilities.  The  ability  to  develop  methods  of  excluding 
large  numbers  of  possible  solutions  is  the  critical  element  in 
this  approach.  To  this  end  bounds  are  developed  in  order  to 
exclude  solutions  which  would  never  be  feasible  or  optimal. 
However,  computational  experience  tends  to  suggest  that  because 
the  bounds  are  not  sufficiently  informative  at  early  stages  of 
the  computation,  large  problems  cannot  be  handled.  Roughly 
speaking  problems  where  the  number  of  variables  exceeds  20 
car  not  be  effectively  solved. 

A  third  approach  has  been  developed  by  Reiter  and 
Sherman  [loj.  They  have  used  statistical  sampling  techniques 
combined  with  methods  for  finding  local  optima.  This  approach 
appears  to  be  quite  effective  for  unconstrained  problems.  For 
the  case  where  the  problem  has  constraints,  a  large  number  of 
the  samples  may  have  to  be  rejected  because  of  infeasibility. 

The  approach  to  be  developed  here  might  be  considered 
an  extension  of  the  methods  using  enumeration.  Instead  of 
relying  on  lower  bounds  to  truncate  the  process,  we  will 
Introduce  a  new  more  powerful  approach  based  on  population 
statistics.  The  use  of  population  statistics  should  not  be 
confused  with  the  sampling  statistics  or  random  search 
procedure  described  above. 

Compu  cat  tonal  Scneme 

This  section  will  outline  the  computational  scheme  used 
in  solving  the  problem.  Typically,  integer  programming  problems 


I 
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are  considered  from  the  point  of  view  of  finding  the  optimal 
integer  values  for  a  vector  of  variables.  We  shall  view  the 
problem  in  a  different  light  -  as  one  of  selecting  the  optimal 
function  among  a  certain  class  of  functions  which  map  elements 
of  one  set  into  another.  For  the  type  of  problems  discussed 
in  this  paper  the  class  of  functions  is  finite.  A  function  or 
map  is  characterized  by  the  way  it  assigns  elements  of  one  set 
to  another  set.  By  a  partial  map  we  shall  mean  the  subset 
of  all  functions  which  agree  for  some  particular  set  of  k  elements 
of  the  domain  of  the  nap.-.  The  naps  in  this  class  will  differ 
in  the  way  they  assign  to  the  remaining  elements  in  the  domain. 

The  integer  programming  problem  can  then  be  formulated 
as  selecting  from  among  the  set  of  admissible  maps  the  one  which 
maximizes  a  linear  functional.  Note  that  not  all  maps  would  be 
admissible  because  of  the  constraints  on  the  problem. 

For  the  zero-one  integer  programming  problem  we  may 
characterize  the  functions  as  those  which  map  the 
integers  I  =  (l,...n)  onto  the  set  (0,  1 } .  There  are  2° 
such  functions. 

It  is  clear  that  one  way  of  solving  the  problem  is 
to  enumerate  all  possible  maps.  As  pointed  out  above  this  is 
obviously  impractical.  The  first  modification  of  a  complete 
enumeration  is  to  implicity  enumerate  all  solutions.  This 
simply  means  that  in  the  course  of  our  enumeration,  certain 
subsets  of  maps  can  be  ruled  out  without  explicit  examination. 


There  is  sufficient  Information  to  show  that  these  subsets  could 


not  contain  a  feasible  optimal  solution*  These  subsets  are  said 
to  be  implicitly  enumerated. 

In  constructing  an  implicit  enumeration  scheme,  there 
are  four  basic  parts  of  tne  procedure; 

1)  A  compact  flexible  enumerative  scheme 

D  Truncation  by  feasibility 

3)  Truncation  by  optimality 

4)  Selection  of  the  next  element  to  add  to  a 
partial  specification  of  the  mapping 

Let  us  consider  the  idea  of  an  enumerative  scheme  in 
the  context  of  the  above  development.  An  enumerative  scheme  is 
a  systematic  way  of  generating  all  of  the  maps.  It  indicates 
which  maps  have  been  already  generated  and,  of  course,  which 
ones  remain  to  be  enumerated.  One  enumerative  procedure  would 
be  to  simply  list  all  maps  that  have  been  examined.  However, 
for  any  reasonably  sized  problem,  the  number  of  possible  maps 
would  be  too  large.  Simple  listing  would  be  impossible 
because  of  the  enormous  memory  requirement.  Thus  a  good 
enumerative  scheme  must  allow  for  a  compact  representation 
of  the  required  information.  In  addition  to  compactness, 
flexibility  in  the  choice  of  successive  maps  is  extremely 
valuable.  For  example,  consider  the  following  possible  way 
of  recording  maps  for  the  present  problem.  Start  with  the 
zero  vector  and  add  the  number  1  successively  in  binary 
form  until  all  binary  vectors  have  been  generated.  Since 


I 


•  map  can  be  uniquely  represented  by  an  n-vector  of  zeros  and 
ones,  this  would  enumerate  all  maps  In  a  compact  manner  while 
Indicating  the  number  of  solutions  already  tried.  However, 
this  scheme,  while  extremely  compact,  does  not  allow  any 
flexibility  of  choice. 

Within  the  class  of  enumeratlve  schemes  which  allow 
for  a  compact  storage,  one  should  strive  for  a  scheme  which 
allows  for  maximal  freedom  in  the  sequence  of  successive  maps 
generated.  We  thus  present  a  general,  flexible  compact  scheme 
for  generating  all  admissible  mappings  of  the  set  S  Into  R. 
While  below  we  present  the  procedure  in  a  rather  abstract  manner 
the  ideas  underlying  It  are  quite  natural.  One  of  the  earliest 
uses  of  such  ideas  Is  due  to  Tarry  [ll]  in  his  algorithm  for 
finding  a  path  through  all  vertices  of  a  rooted  graph.  We 
proceed  in  the  following  manner  where  the  steps  follow  con¬ 
secutively,  unless  indicated: 

0.  Initialize  by  setting  ksl  and  determine  and  according 
to  a  specified  rule,  perhaps  determined  by  feasibility. 

1.  If  R^  Is  empty  go  to  7 

2.  Select  any  elements 

1*  esk 

J*  €Rk 

Set  i^i*  and  Jk=J*  and  Rk=Rk-[j*] 

3 .  If  ksn  go  to  11 


4.  Set  k+lak 


7 


5.  Determine  and  according  to  some  specified  rule, 
perhaps  determined  by  feasibility 


6.  Go  to  1 

7.  If  k&l  stop 

8.  Set  k-lak 

9.  If  R^  is  empty  go  to  7 

10.  Select  any  element  J*  «R  .  Set  J to  go  with  the 

k  _  —  -  jt— 

current  ik  and  set  R^sR^-J*  and  go  to  3 

11.  Record  the  current  mapping 

12.  Go  to  9 

In  the  present  case  we  take  SkS^  =  (l,2,...n), 
R=Sj  =  (0,1}  and  in  Step  5  we  set 


sk*s"tVi  lt 


and 


Rk*(0,l} 

These  choices  generate  the  desired  maps.  With  the  above  specifi¬ 
cation  the  general  enumeratlve  scheme  given  here  reduces  to  one 
proposed  by  Glover  [  6  ]  to  solve  the  0-1  Integer  programming 
problem. 


Another  application  of  the  general  enumeratlve  scheme 
is  to  the  generation  of  all  n!  permutations  of  the  integers 
Ia(l,2, . . .n} .  For  this  application  we  set  S^S^  * 

RsR^  =  (l,2,...n)  and  in  Step  5 


sk-*-S5 


V**5ii  Jt 


(1,2,.. .n} , 


8. 

A  variant  of  this  mapping  scheme  was  used  to  solve  the  quadratic 

assignment  problem  as  given  In  [8] 

Step  two  In  the  enumeratlve  scheme  involves  the  selection 

k-1 

of  a  particular  variable,  i.e.;  an  element  from  the  set  S~\j 1 

t=l  1 

and  Its  assignment  to  either  the  element  zero  or  one. 

Because  of  the  powerful  selection  mechanism  to  be  developed 

below,  the  flexibility  of  being  able  to  select  the  variable  Is 

not  needed  in  the  present  application.  The  order  in  which  we 

treat  the  variables  will  be  fixed.  The  enumeratlve  procedure 

is  altered  slightly  to  account  for  this  change.  Let  [1  ...1  ) 

1’  n 

be  an  ordering  of  the  integers  (l,2,...n).  Then  set  }  f 

S  *  { 1  )  ..  S  =(i  ).  By  renumbering  the  variables  we  may  assume 
2  2  n  n 

that  S^l),  S2»U),...Sn=(n). 

The  enumeratlve  procedure  has  the  effect  of  transforming 

the  Integer  programming  problem  into  an  n-stage  decision  problem, 
th 

At  the  k  stage  of  the  algorithm  we  have  to  decide  what  value 
to  assign  the  variable  x^.  There  are  two  considerations. 

First  the  local  or  immediate  effect  of  setting  x  to  a  value. 

K 

By  setting  x  =1  the  criterion  value  is  Increased  by  c  (our 

K  K 

Immediate  cost)  and  each  constraint  is  altered  by  the  value  a  . 

1 K 

The  alternative  choices  of  zero  or  one  for  x  determine 

k 

alternative  subsequent  problems  in  which  possible  choices  for 

x . x  are  differently  restricted  because  of  the  a,,  .  This 

k+1  n  ik 

second  factor,  the  potential  future  cost,  is  the  crucial  factor. 

What  is  the  cost  of  the  alternative  restrictions  on  the  subsequent 

possible  assignment  of  values  for  the  remaining  x,  ,...x  ? 

k+1  n 


If  one  were  able  to  evaluate  the  second  factors  exactly 
it  would  be  possible  to  assign  at  each  step  the  correct  value  and 
solve  the  problem  exactly  in  n  steps.  This  is,  of  course,  not 
possible.  The  next  best  thing  to  knowing  exactly  the  values  of 
the  completions  is  no  know  them  almost  surely.  The  use  of 
probability  usually  enables  us  to  obtain  very  good  Information 
at  a  fraction  of  the  cost  of  obtaining  exact  information.  It 
is  to  capitalize  on  this  that  we  develop  the  present  approach. 

It  should  also  be  observed  that  in  the  large  scheduling  and 
allocation  problems  for  which  this  algorithm  is  intended,  the 
uncertainties  in  the  underlying  data  reduce  attempts  to  obtain 
the  exact  optimal  solution  with  certainty  to  pedantry. 

What  is  required  for  present  purposes  is  the  probability 
distribution  of  the  values  of  the  linear  functionals  over  the 
discrete  sample  space  of  the  remaining  2°  k  completions  of  the 
current  k-partial  map.  Although  it  is  impossible  to  obtain 
the  exact  multivariate  distribution  desired  without  complete 
enumeration,  the  really  useful  fact  is  that  we  can  obtain  the 
vector  of  means  and  covariance  matrix  of  this  distribution 


exactly  and  an  asymptotic  approximation  to  the  distribution. 
Statistical  Properties  of  the  Problem 

Let  x  be  random  variables  which  have  the  following 

J 

probability  distributions: 


Pr(x  =1)  =  1/2  and 
Pr  (x^=0)  =  1/2 


and  further  assume  the  x 


J 


to  be  Independent. 


10. 


Then  =  ^_iaijXj  *s  also  a  random  variable  whero(a^}  is  any 
set  of  real  constant:  .  The  means  variances,  and  covariances 
of  linear  functions  of  random  variables  are  wel 1  known. 

“‘V  =  JVj 

2 .  .  r  2  2 

’  <V  * 


and, 


where 


c (a  ,55  ) 
P  Q 


£>“a  .  a 

JJ  PJ  qJ 


l-j-E<xj>i  32  =  E(v  / 


c  (55  ,54  )  =  E[  (54  h  (Z  )(2  -+~(2  )] 
p  q  P  P  q  q 

2 

Now  in  our  particular  case  since  L ^=1/2  and  j  =1/4 
these  formulas  reduce  to: 


• 1/2  ?« 
"“‘V  =  1M  f°2ij 


and, 


||  c(8pl8q)  II  =  1/4  II  Japj.aqj  II. 

Further,  the  3^  are  sums  of  independent  random  variables.  Taking 

2 

x.,  =  a4,  x.  thpn  L  ( x  )  =  a  and  ^(x,.  )  =  a  . .  .  .  and 
lk  ik  k  ik  ik/2  ik  ik/4 

2,  =  ,2  x  .  The  Lindeberg  theorem  [d  ]  states:  "Let  x  ,  ,  , 

in  k=l  ik  il 

x  ,  ...  be  mutually  independent  one-dimensional  random  variables 


with  distributions  F  ,  F,. . 


Assume  E(x  1R)=0  [e.g  xik=xik‘E<xik) 


and  put  n  (54  )  =  7“(x  )  +  0  (x  ),...-*  ~  (xi  ). 

in  il  12  in 

Assume  that  for  each  t  "m 


1  im 


n  -•  oc  '  ( f.  ) 

i  n 


n 

\ 

L 

k=l 


y"  FR(Jyl  =  o 


y|  S  t  =  (nln) 


11. 


then  the  distribution  of  the  normalized  sum 

~  Z,  ~E(Zt  ) 

B,  =  in  in 
in  — - 

^(ain> 

tends  to  the  normal  distribution  N  (0,1)." 

Now  assuming  all  the  aj ,  ar’  from  a  bounded  set,  since 

ik  2 

cr^(Z  )-  as  n-  00  for  any  t  ^  0  the  integrals  P  ^  Fk  .  =  0 

in  J  O  J  lyj>  t  rr  (g  ) 


in 


for  sufficiently  large  n,  and  the  required  condition  for  the 


LindeLarg  theorem  is  satisfied.  The  fact  that  for  large  numbers 
~  8  -  E  ( 8  ) 

of  variables,  2  =  i  i  is  approximately  normal,  enables 

7(3^ 

one  to  estimate  the  minimum  values  of  the  2^  almost  surely  as 

follows:  P  (2  <  c  )  =  a  is  readily  obtainable  from  normal  tables 

r  l—  O' 

for  any  confidence  level  a.  Hence,  P  (2,<E(Z  1  +  c  a(Z .)  )  =  or 

r  i—  i  or  i 

is  available  for  each  of  the  2^. 

The  above  results  can  be  extended  to  obtain  confidence 

level  statements  about  the  joint  or  coupled  behavior  of  the  2^. 

The  Lindeberg  Theorem  is  readily  extended  to  show  that  the  vector 

(2,,  2  , ...  ,2  )  is  asymptotically  multivariate  normal, 
i  i  n 


Confidence  Level  Implicit  Enumeration 

In  the  course  of  the  underlying  enumeration  it  is 
necessary  to  apply  the  results  of  tne  previous  section  to  the 
truncated  random  variables  dictated  by  the  successive  fixing  of 
elements  of  the  map.  To  this  purpose,  we  introduce  the  following 
def initions : 


Z^k)  -  k+ J  4  ,l  k-*2 


—  ■*  a  ,  X 

in  n 


for  1  <  k  <  n  and  B^(n)  =  0, 


♦ 


12. 


ZA(k) 


‘llXl  +  fti2X2  +  * '  ,ai ,k-lXk-l 


for  1  <  k  <  n  and  8^(1)  *  0 

where  (x  x„  )  are  the  already  chosen  fixed  values  for 

1 >  2 ,  k-1 

these  variables. 

The  criterion  function  is  designated  8  a  c ,x,+c „x  + . .  ,+c  x  . 

b  c  1122  nn 

As  is  customary  in  the  zero-one  problem,  we  assume  that  the 
c  >  0.  This  does  not  restrict  complete  generality  inasmuch  as 

J 

I 

the  simple  translation  of  variables  x  =  1-x  for  *he  c  <  0  will 

J  J  J 

Insure  this  condition. 

The  most  elementary  use  of  the  statistical  properties 
developed  in  the  previous  sections  is  to  supplement  the  bounds 
employed  in  the  deterministic  implicit  enumeration  as  expounded  by 
Dalas,  Glover  and  others.  To  see  how  this  can  be  done,  let  us 
recapitulate  the  use  of  bounds  for  implicitly  enumerating.  Take 
Z1(k)  =^E_  a^  where  Sl  =  (J  |  a^  <  °  and  k<  J  <  n  ) 
and  clearly  E^Ck)  >  Z^(k).  Now  for  a  feasible  solution 

*1  -  Vk)  *  *  Vk>  i  b! 


^(k)  <bj  -  »j(k) 

So  the  possible  completions  of  the  partial  map  are  implicitly 
enumerated  if  for  neither  value  of  x  is 


Vk)  s  b,  -  si(k,-»ik\ 


while  the  value  of  \  Is  fixed  if  tae  inequality  holds  for  one  value 

but  not  the  other.  The  above  argument  applies  as  well  to  the 

* 

criterion  function  when  b  xs  rcplnced  by  5  the  best  known 

t  c 

feasible  value,  with  the  additional  fact  that  S  =0  and  hence 

c 


8  (k)=0 . 
c 


13. 


The  simplest  use  of  the  statistical  properties  of  our 
problem  would  then  be  to  use  the  estimated  minimum 
Z|(k)  =  E(Z  (k))+  c^B  (k> 

in  place  of  the  absolute  bound  fe^k)  in  the  above  argument.  The 

possible  completions  of  the  partial  map  are  then  implicitly 

enumerated  with  a  confidence  level  of  a.  Confidence  level  implicit 

enumeration  is  an  agreement  not  to  check  further  those  subsets  of 

maps  that  have  less  than  a%  chance  of  containing  a  better  feasible 

solution.  It  should  be  noted  that  by  its  construction  Z^(k)  is  a 

n-k 

random  variable  on  the  finite  sample  space  of  the  remaining  2 

completion  maps  with  equal  probability  of  —  for  each  map. 

Now  V  (k)=b  -ZJ (k)-a  x,  establishes  a  cutoff  value  (with  a  choice 
i  l  i  lk  k 

of  a  value  for  x,  )  for  a  feasible  solution  of  the  ith  constraint, 
k 

By  fixing  a  and  calculating  the  corresponding  critical  value 
Z|(k)  from  the  normal  distribution  if  Z^(k)  >  V^k),  we  can  then 
infer  the  probability  (or  relative  frequency)  of  the  maps  that 
would  yield  feasible  solutions  to  the  ith  constraint  is  less  than 
a.  By  considering  all  of  the  constraints  Jointly,  the  probability 
that  a  feasible  map  could  be  found  would  be  diminished.  Schematically 
the  situation  would  appear  as  follows(see  fig.  1): 


The  total  shaded  area  contains  >7,  of  the  maps  and  the  area  to  the 
left  of  V^(k)  contains  less  than  a 7  of  the  maps.  It  should  be 


observed  that  the  truncation  of  the  tails  of  the  normal  distribution 


because  of  our  finite  space  approximation  would  cause  the  variances 
to  be  over  estimated  and  hence  make  the  procedure  even  more  con¬ 
servative.  In  fact  as  k  approaches  n  and  the  normal  approximation 
becomes  less  valid  the  procedure  will  undoubtedly  automatically 
merge  into  the  deterministic  one  where  only  the  absolute  bounds 
will  cut. 


A  more  advanced  use  of  the  statistical  properties  of  the 
problem,  which  would  undoubtedly  yield  much  greater  cutting  power, 
would  be  to  implicitly  enumerate  subsets  of  maps  which  have  low 
percentages  of  maps  which  satisfy  the  constraints  pairwise. 


Relying  on  the  fact  that  any  pair  of  the  random  variables  Z^fk) 

and  S*  < k)  has  an  asymptotic  bi-variate  normal  distribution,  we 
J 

can  use  the  conditional  probability  distribution  of  Z^(k)  given 
Z^fk).  In  this  instance  Z^(k)  is  asymptotically  normally 
distributed  about 


c(Z  (k),Z  (k))  „  . 

(Z  (k))=  E(Z  (k))+ - - - J -  (  a  (k)-E(S  (k))  '  with 

J  J  -  (Mk)) 


.  2  2.  '  "0(3,  (k) ,  »  (k)  ) 

variance  r  =  n  (8  ( k))  .  11-  i _ j 

J  J  't(ai(k))'T(a  (k))- 


The  conditional  distribution  of  Z^(k)  depends  on  the  particular 
value  of  Z^(k)  chosen.  For  the  purpose  of  obtaining  a  critical 
point  we  may  choose  a  realizable  value  of  Z^(k)  which  gives  the 
lowest  and,  therefore,  weakest  critical  value.  Now  for 


c(Z (k),  Z  (k))  <  0  the  minimum  value  of  ^.(Z  (kl)  occurs  by 
i  J  J  i 


using 
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Y(i)  =  min  2*(k) ,V for  8^(k)  where 

fe*(k)  =  S  +  a_  and  S*  =  {p  I  a4  >0  and  k  <  p  <  n)  . 

i  PeSA  lk  1  1  ip  - 


With  cfZ^Ck)  ,2^(k))  >  0  the  minimum  value  of  p.(Z^(k))  occurs  by 
using  \(i)  =  Z-^k)  . 

/  / 

In  either  instance  one  can  use  Z  ( k ;  i )  =  ^(Y(i))  +  c  a 

j  ^  J  •  i 

i 

in  place  of  2^(k)  in  the  preceding  arguments.  For  each  variable 
»  ^  (  k  )  ,  1  1  J,  a  crltial  point  *( k , i )  Is  obtained.  Let 
Zj  (k)  denote  the  maximum  value.  This  value  constitutes  the  best 
bound  obtainable  using  the  constraints  pairwise.  In  practice, 
of  course,  the  critical  points  would  be  generated  sequentially. 

At  each  step,  the  algorithm  checks  whether  the  critical  point 
exceeds  V^k)  or  not. 

The  most  general  use  of  the  statistical  properties  of 
the  problem  would  be  to  calculate  directly  the  probability  of  the 
set  of  completion  maps  which  simultaneously  satisfy  all  the 
constraints  and  yield  a  better  value  of  the  criterion  function 
than  currently  known.  This  would  be, 


Pr(Z  (k)<  V  (kJ.Ztk)  <  V  ( k) . Z  (k)  <  V  (k) ) 

c  c  l  i  in  m 

Theoretically,  for  each  choice  of  a  value  for  x  ,  tills  probability 

K 

can  be  calculated  approximately  from  the  asymptotic  multivariate 
normal  distribution.  In  practice  although  considerable  research 
has  been  done  on  the  subject  over  a  large  period  of  time,  there 
does  not  appear  to  be  effective  means  of  computing  directly 

5 

this  probability  beyond  the  bi-vnrlale  case. 


**;*«.* 


In  terms  of  the  overall  algorithm,  information  from 


the  above  tests  is  used  in  step  5.  If,  when  setting  x  =1,  we 

K 

determine  by  use  of  the  bounds  that  a  possible  completion  is  to 

be  ruled  out  we  set  R  =R  -fl).  Similarly,  in  the  case  where 

k  k 

x  =0  is  tested,  we  set  R  =R  -(0).  If  we  could  compute  the  r.ulti- 

K  K 

variate  normal  then  we  rule  out  either  or  both  values  if  their 

I 

respective  probabilities  are  less  than  a  confidence  level  » . 

Consider  the  case  where  neither  value  can  be  ruled 
out.  Step  two  in  the  enumerative  scheme  calls  for  mapping  the 
element  i*=k  into  ar  element  J*  {0,l)sR  .  This,  of  course, 
corresponds  to  .electing  a  value  for  of  zero  or  one.  Note 

IV 

that  either  choice  should  lead  to  an  improve,  feasible  solution. 
While  the  enumerative  scheme  guarantees  tnat  if  necessary  both 
values  will  be  checked,  it  is  important  for  computational 
efficiency  to  make  a  Judicious  cnoice.  By  making  a  choice  which 
leads  to  a  feasible  solution  with  a  lower  value,  we  obtain  a 
sharper  cut-off  point.  This  cut-off  point  allows,  in  subsequent 
generation  of  maps,  the  implicit  enumeration  of  larger  subsets 
of  maps  tnan  would  be  possible  if  a  feasible,  but  higher  value 
of  the  criterion  l  inction  is  obtained.  In  order  to  achieve  this 
we  elect  to  check  first  that  subset  of  maps  which  contains  a 
larger  proportion  of  improved  feasible  solutions. 
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Conclusion 

As  is  well  known,  many  problems  in  combinatorial 
programming  can  be  reduced  to  problems  in  variables  restricted 
to  the  values  zero  and  one  by  various  artifices.  The  attempt 
to  convert  these  problems  to  integer  mathematical  programming 
problems  by  introducing  large  numbers  of  structural  constraints 
on  the  variables  has  not  proved  computationally  effective. 
Combinatorial  programs,  almost  by  definition  are  associated  with 
maps  of  one  finite  set  into  another  and  thus  generate  a  finite 
class  of  maps  which  can  be  enumerated  by  the  general  algorithm 
presented  here.  It  is  our  intention  to  attack  these  different 
problems  by  characterizing  the  statistical  structure  of  the 
associated  finite  class  of  maps.  Our  technique  consists  of 
trying  to  identify  the  optimal  feasible  map  in  a  class  of  maps 
by  introducing  random  variables  as  functionals  on  the  class  of 
maps . 

In  an  earlier  paper  [ f  ]  the  authors  have  applied  the 
above  ideas  to  a  different  type  of  mapping  scheme.  Some  pre¬ 
liminary  computational  results  were  given  in  that  paper.  Future 
papers  will  develop  other  types  of  maps  and  their  statistical 
properties  and  show  how  these  maps  can  be  used  to  solve 
important  industrial  problems. 
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FOOTNOTES 

1.  For  a  discussion  of  methods  of  transforming  problem  (2) 
into  tho  form  of  problem  (1)  see  [  1 ]  . 

2.  See  •  .g.  [5]  for  a  presentation  of  Gomory's  approach  to  the 
problem. 

3 .  See  also  [  4 ] . 

4.  See  [3;  for  a  discussion  of  such  extensions. 

5.  In  [9]  a  comprehensive  survey  of  the  area  is  given. 
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